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Abstract Recent algebraic parametric estimation techniques (see [Ttlllll] ) led 
to point- wise derivative estimates by using only the iterated integral of a noisy 
observation signal (see pMll25j ). In this paper, we extend such differentiation 
£C} . methods by providing a larger choice of parameters in these integrals: they can 

be reals. For this, the extension is done via a truncated Jacobi orthogonal series 
expansion. Then, the noise error contribution of these derivative estimations 
is investigated: after proving the existence of such integral with a stochastic 
process noise, their statistical properties (mean value, variance and covariance) 
are analyzed. In particular, the following important results are obtained: 

> \ 

a) the bias error term, due to the truncation, can be reduced by tuning the 
parameters, 

b) such estimators can cope with a large class of noises for which the mean 
and covariance are polynomials in time (with degree smaller than the order 

J> , of derivative to be estimated), 

' c) the variance of the noise error is shown to be smaller in the case of negative 

real parameters than it was in [231125] for integer values. 
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Consequently, these derivative estimations can be improved by tuning the pa- 
rameters according to the here obtained knowledge of the parameters' influence 
on the error bounds. 

Keywords Numerical differentiation • Jacobi orthogonal polynomials • 
Stochastic process • Stochastic integrals • Error bound 

Mathematics Subject Classification (2000) 65D25 • 33C45 • 60H05 • 
60J65 

1 Introduction 

Numerical differentiation is concerned with the estimation of derivatives of 
noisy time signals. This problem has attracted a lot of attention from different 
points of view: observer design in the control literature (see [^1I51 [TH[T51[T71I55] ) . 
digital filter in signal processing (sec [2 , 3, 6 , 30, 33 ) and so on. The problem of 
numerical differentiation is ill-posed in the sense that a small error in measure- 
ment data can induce a large error in the approximate derivatives. Therefore, 
various numerical methods have been developed to obtain stable algorithms 
more or less sensitive to additive noise. They mainly fall into five classes: the 
finite difference methods [1511591151] . the mollification methods [I21I251I27] . the 
regularization methods 28,39,37], the algebraic methods [251124] that are the 
roots of the here reported results, the differentiation by integration methods 
[T511521158112T] . i.e. using the Lanczos generalized derivatives. 
The Lanczos generalized derivative Dtx, defined in [18) by 



is an approximation to the first derivative of x in the sense that Dxxfa) = 
x' (to) + 0(T 2 ), where / is an open interval of K and 2T > is the length of 
the integral window on which the estimates are calculated. It is aptly called a 
method of differentiation by integration. Rangarajana and al. |32j generalized 
it for higher order derivatives with 



where x is assumed to belong to C n+2 (J) and L n is the n th order Legendrc 
polynomial defined on [—1,1]. The coefficient j n is equal to lx3x5x '^ x ( 2n+1 ) _ 
By applying the scalar product of the Taylor expansion of x at to with L n they 
showed that D^ ] x(t ) = x^ n \t ) + 0{T 2 ). By using Richardson extrapolation 
Wang and al. [38] have improved the convergence rate for obtaining high order 
Lanczos derivatives with the following affine schemes for any neN 




(1) 




vto e i, 41*(*o) = 



i 



Lu{t) (o n x(t + TV) + b n x(t + A„Tr)) dr, 



-i 



(3) 
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where x is assumed to belong to C n+4 (/), a n , b n and A„ are chosen such 
that D^ Xn x(t ) = x^ito) + 0(T 4 ). Recently, Liu et al. [21] further reduced 
the convergence rate in these high order cases by using Jacobi polynomials in 
their derivative estimators. Let us mention that all these previous estimators 
are given in the central case, i.e. they use the interval [t$—T, to+T] to estimate 
the derivative value x^ n ' (to). Hence, these central estimators are only suited for 
off-line applications whereas causal estimators using the interval [to — T, to] are 
well suited for on-line estimation which is of importance in signal processing, 
automatic control and in general in many real time applications. 

Very recently, Mboup, Flicss and Join introduced in [5] and analyzed in 
[251124) a new causal and anti-causal version of numerical differentiation by 
integration method based on Jacobi polynomials 

Vi G I, D^x (n Ht ) = J w^{t)P^{t) y(t + (3Tr) dr, (4) 

where n G N, y = x + vj is a noisy observation of x which is assumed to 
be analytic, w denotes a noise, T > is the length of the time window for 
integration, /3 = — 1 (causal version) or /3 = 1 (anti-causal version) and P£' k 
is the n th order Jacobi polynomial defined on [0, 1] (see [I], [3H) by 



vt g [o, i], PT(t) =E( ^ t s > (5) 

associated to the weight function 

w^ K {t) =t K {l-ty. (6) 

Let us mention that originally, these estimators were obtained using an 
algebraic setting: for this the authors applied a differential operator on a trun- 
cation of the Taylor series expansion of x in the operational domain. This 
operator is given by 

2 d nJrK 

= TTT r^T" • g7 \ with /! G N, (7) 

s being the Laplace variable. It is in fact an annihilator which "kills" the 
undesired terms except the one we want to estimate (see [25l[24] for more 
details). This is the reason why, originally in PMM], the parameters k, /j were 
assumed to be integers (k, /i, G N). In that case, the coefficients 

ln (ti + n)\(K + n)\ " [ ' 

Let us emphasize that those methods, which are algebraic and non-asymptotic, 
exhibit good robustness properties with respect to corrupting noises, without 
the need of knowing their statistical properties (see J7[[5] for more theoretical 
details). The robustness properties have already been confirmed by numerous 
computer simulations and several laboratory experiments. 
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The derivative estimators given by (j?]) contain two sources of errors: the 
bias term error which comes from the truncation of the Taylor series expansion 
and the noise error contribution. Let us note that a precise analysis for the 
noise error contribution of a known noise has been done: 

— in [20], for a specific identification method, 

— in [15] , for discrete cases by using different integration methods, 

— in 33, which shows that an affine estimator induces a small time delay in 
the estimates while reducing the bias term error for integer parameters 

K,fl. 

Thus, the aim of this paper is to reduce the errors of such derivative esti- 
mators. 

For this, Section [5] allows re, fx to be real: since the use of (J7| induces some 
natural limitations (re, /i, £ N) we use truncated Jacobi orthogonal series to ob- 
tain a natural extension of Q. Let us recall that, in [35], such truncated Jacobi 
orthogonal series were shown to be related to (0 and the obtained estimators 
(|4|). Such obtained estimators are thus called minimal Jacobi estimators and 
are clearly rooted from [2"5] . 

After providing such extension (—1 < re, /i £ R), Section 3 analyzes the 
bias term error: it is shown, for minimal Jacobi estimator, that if the (n + 
l) th derivative of the signal x is slowly changing within the time window of 
observation then one can reduce the bias term error making T „ small 

by tuning the parameters T, re, fi. Lastly, it is shown that for affine estimator 
(real affine combination of the introduced minimal Jacobi estimators), the 
time delay can be reduced with the extended parameters comparing to the 
one obtained in |25j . 

Section [4] analyzes the noise error contribution in order to provide some 
guides for tuning the parameters T, re, [i. For this we consider two cases: con- 
tinuous and discrete cases so as to give noise error bounds by using the Bien- 
ayme-Chebyshev inequality. In the first case for noises which are continuous 
parameter stochastic process with finite second moments, the mean value func- 
tion and the covariance kernel of these noise error contributions are calculated 
leading to: 

— for noises whose mean value function and covariance kernel are polynomials 
of degree r < n then the noise error contribution e^(to) = almost surely, 

— for Wiener or Poisson process some bounds are obtained for the noise error 
contribution: explicit for n = 1,2 and it is shown how to deal with the 
general case. 

The discrete case leads to similar results under some modified assumptions. 

In Section[5j a parameter is introduced in order to reduce the error due to a 
numerical integration method when the extended parameters become negative. 
Then the comparisons of the Jacobi estimators with extended parameters and 
the ones with original parameters are finally done for the cases where the 
noises are respectively a white Gaussian noise and a Wiener process noise. 
The integral of the total square error and the classical SNR are considered 
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for these comparisons. Some interesting "delay-free" estimations in simulation 
results arc shown. 



2 Jacobi estimators 

Let us start with y = x + w a noisy observation on a finite time open interval 
/ C R + of a real valued smooth signal x which n th derivative has to be 
estimated (n 6 N), and w denotes a noise. Let us assume that x £ C n+1 (I). 
For any to £ I, we denote V to = {t 6 R + ; t + fit £ 1} where f3 = ±1. 

In the two following subsections, we aim at extending the parameters k, \x 
used in the estimators described by (@J) from N to ] — l,+oo[. To do so, we 
follow [55] by taking the truncated Jacobi orthogonal series. Let us stress that 
(|3]) leads to two families of anti-causal (/? = 1) and causal (0 = —1) estimators. 

Let us mention that, Kgl means a non integer differentiation with respect 
to s in {7J but has nothing to do with the estimation of non integer derivatives 
of noisy time signals. However, such estimation of non integer derivatives could 
be tackled by similar technics. 



2.1 Minimal estimators 

Since x £ C n+1 (I), we can take the Jacobi orthogonal series expansion of x^ 

W/ <= T U n )(i i RTf\ - \ " {P? +n ' K+n {T),x {ri) (l3TT + tp)) ^ +n K+n 
Vi 6i, '{t + pit)- ^ M+ », K+n t J l [t), 

i>0 " i II 

(9) 

where t £ [0,1], /3 = ±1, T £ V U) , n £ N, and K,(i£] - l,+oo[. 

By taking the first term in © with t = 0, we get the following estimations 



w, j rui.n (»)/■ N _ {Po +n,h+n {r),x { - n) {fiTT + 1 )) ^ +wre+rt 

Vt 6 1, Dp T X^ '(t Q ) - ||pM+ n, K +n|| 2 F 

1 





1 



B(k + n + 1, ix + n + 1) Jo 



w M+»,K+«( r ) x {n) + /3Tr ) dTj 
(10) 



where B(-,-) is the classical Beta function. Recall the Rodrigues formula 
d" 



dr 1 



{(1 - rr+« T K+,i } = (-l) n n!(l - tYt k P^ k (t). (11) 



Then, by taking n times integration by parts and using the Rodrigues formula 
in (fTU)) we get 



Vto 6 I, D^x^{to) = I ' w^(t)P^{t) x(t + PTt) dr, (12) 
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where 7^ ,K = B ( K+ra+ " ! ^ +ra+1 ) (the natural extension of ©). Now replacing x 
in p2p by its noisy observation y, one obtains (UJ) with /3 = ±1, T G Pt , n 6 N, 
and ft, /U g] — l,+oo[. Let us emphasis that these estimators were originally 
introduced in [35] with k,/i£N and since they are obtained by taking the first 
term in the Jacobi series expansion, we call them minimal Jacobi estimators. 
Hence, it is natural to extend these two parameters from N to ] — 1, +oo[. 

2.2 Affine estimators 

The Jacobi orthogonal series expansion of xW is the projection of i" onto 
the Jacobi orthogonal polynomial basis. The minimal Jacobi estimators are 
introduced by taking the first term in the Jacobi series expansion of x^ n ' at 
t = in the previous subsection. Let q G N be the difference between N 
(the truncation order of the Taylor series expansion of x) and n (the order 
of derivative we want to estimate). We give in this subsection two families of 
estimators by taking the q first terms in the Jacobi series expansion of x^ n ' at 
a set point £ as follows 

V< G /, D pT N ^ '(to) := 2^ |ipM+n,«+n|| 2 P i (0. 

i=0 II » II 

(13) 

where £ G [0, 1], = ±1, T e D to , n G N, and 1, +oo[. 

These estimators were originally introduced in [2 5) with /c, /i G N and 
q < n + k. Moreover, it was shown that these estimators could be written as 
an affine combination of some minimal estimators. Hence, (fl3|) proposes here 
two families of extended estimators which can also be written as follows 

D^N^Hto) = ^"^(to), (14) 

1=0 

where (Ki,fJ,i) = (n+q+l, fj,+l) G K 2 and the minimal estimators ffi Kl 3;W (t ) 
are defined by The coefficients A;(£) G K arc the same as the ones given 
in |25j . Thus, we can call them affine Jacobi estimators. 

Let us denote by v^t n (respectively PprnN^) the P ower functions used 
in the integral of the minimal estimators Dp^E (to) (respectively the affine 
estimators N (to)) ■ Then according to ((H), we have 

ftW = ^^' K (r)Pr(r). (15) 
From (H3J), we can infer that 

P^T M (r) = j^m)p^). (16) 

1=0 
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If we take TV = n and £ = in the afnne estimators, then wc obtain 
^7\JV=n,e=o a;(Tl K*o) = DpTX^Hto). Consequently Dp^N^^^o) S ives a 
general presentation for minimal estimators and afnne estimators. We call 
them Jacobi estimators. 

Now, by a direct adaptation from [25], we can obtain the following propo- 
sition by using some properties of the Jacobi orthogonal polynomials. 

Proposition 1 Let (to) be the minimal Jacobi estimators with n > 1, 

then we have 

D^x^ (t ) = -{A+B)b^x^ (t )+AD^ +1 x^ (t )+Bb^ 1 ' K x^ (t ) 

(17) 

where (n + ft) A = -(n + k)B = (A1+K+2 "+ff ^' +K+2n) . 

Proof. We need the following (adapted from [I] (p. 782)): 

(2n + 2 + ^ + K )(l-r)P^(r) = (l+n+/i)P^(r)-(n+l)i^i(T). (18) 

(2n + 2 + M + «) r P^ K+1 (r) = (1 + n+ ^"(r) + (n + l)i£&(r). (19) 
Subtracting (fT5|> from (flU)) gives 

« W - ^TfrXr) + 2 "2 ( ^" } +/X W K+1 (r) - (1 - ^^M] . 

(20) 

By using ([201), © becomes 
tes<»>(io) = ^cg£„ /'(I -TYT«P^{T)ytfTr + t )dr 



2 " + 2^ i (1 - -)^ K+1 « +1 W I/CSTr + t a )dr 



with cjgjT n = jgryi ■ Since 



/ t . / V 



n! r(^ + K + 2n + 2) 



/37> (/3T)"r(n + K+l)r(^ + n+l) 





n 


(m- 


f K 


+ 2n 


+ 1)(/K + K 




PT 






(n + 


ft) (/i + n) 




n 


M "+ 


- K - 


\-2n- 




C /3T,n 


@T 




rc 


■f /X 


C ,3T,n-l' 


fi,K 


n 


t 1 "+ 


- K - 


1- 2n- 


r" 1 (U+l,« 


C /3T,n 


pr 




n 


+ K 





C /3T,ra-l> 



one can complete to obtain (fT7|) . 
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2.3 Two different sources of errors 



Since J Q p^ n (r)<iT ~ (pry an< ^ us i n S t ne orthogonality of the Jacobi poly- 
nomials, one obtains 



x {n) (t )= I P ^ n (T)x n (f3TT + t )dT,Vt Q eL (21) 
Jo 

where P^„(r) is given by (15]) and .t„(/?Tt + t ) = ^ ., x (t) (to). Since 



i=0 



z„(/3Tr + t ) = y(/?Tr + to) - i?„(/3Tr + t ) - m(/3TT + t ) (22) 

where R n {(3Tt + t ) = ^^ ar (n+1) (^±) with 6L e]t - T<r,t [ and 0+ e 
]*o,*o + Tr[, we obtain by replacing $Z2§ in ([2"T]) 

a;W(to) = ^ K x(")(t ) - (e£>(*°) + ( 23 ) 

where 



e^%T(*o)=/ p^ n (r)^^Tr + to)rfT, (24) 
Jo 

<V(*°)=/ P^„(r)roC8rr + fo)dr. (25) 



Thus the minimal estimators fei'"^^) are corrupted by two sources of 



j9T 

errors: 



— the bias term errors bt^o) which comes from the truncation of the 
Taylor series expansion of a;, 

— the noise error contributions e^^ T (to). 

Q 

For affine Jacobi estimator, as soon as A/(£) = 1, using fj 14[) we have 

1=0 

D^,N,e in) (to) = (*o) + E A,(0 (e^>(t ) + e£#,fo)) 

1=0 

= x (n) {t ) + e^ pTNi (t ) + e%" pTtN£ (to), 

where £r K p T N ^(to) an d ^V"^' ) are respectively the bias term error 
and the noise error contributions for these Jacobi estimators (minimal or not). 
They are given by 



e R n , BT,NAh) = / p7 T n At) R n ((3TT + t )dT, (26) 
Jo 

e W?Tyv,f(*°) = / P$T,n,N,c( T ) ™{PTt + t )dr. (27) 
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3 Analysis of the bias error contribution 

This analysis is done for minimal and affine Jacobi estimators. In both cases it 
is possible to reduce the bias term error by tuning the parameters T,K,fj,. For 
minimal Jacobi estimator one can get an overvaluation of this error using a 
Taylor expansion with integral reminder whereas in the afhne case it is better 
to follow [25] . 



3.1 Analysis for minimal Jacobi estimators 

The following result states that as soon the n+1 time derivative of the signal 
x is slowly changing on the time window of observation then one can reduce 
the bias term error making T ^+^+211+2 as sman as possible. 

Proposition 2 Let IIoti'™'^) be the minimal Jacobi estimators defined by 
^ for x^ n '(to). Then the corresponding bias terms errors can be bounded by 



/~tV' K q— (1 \ <r r'f l ' K T~ 

^_T D ri+l ^ e R n .-T\ l 0) i 0_ T J n+1 , 

where C^=t3T ^+ n \ 2 and 

7+ +1 = inf x^ +1 \e + \St l+1 = sup x^ +1 \8 + ), 
to<e+<t a +T t <e + <t +T 

S- +1 = sup x^ +1 He.),I~ +1 = inf x^(d-)- 

t -T<6-<t a to-T<B-<t 



(28) 



(29) 



Proof. Let us take the Taylor series expansion of x^ n >{to + (3Tt) in (|TD|) . then 
we have 



Vt e I, D$xV>(%) = 7 ,r / w»> K (T) X W(t + (3TT)dr 

Jo 

= l£ K I w*«{t) (xt\t + pTr) + R n (f3Tr + i )) dr, 



where R n {j3TT + 1 ) = /3Ttx^ +1 ^ (6±) with 0_ e]t - Tt, t [ and 0+ e]t ,t Q + 
Tt[. Thus, the bias term errors is given by 

eST«r(*o) - PTrt K [ w^ +1 (t)x^ +1 H§ ± ) dr. (30) 
Jo 

Then, this proof can be easily completed by taking the Beta function and the 
extreme values of x^ ra+1 ^ (0±). M 
As shown in gS], when /3 = -1 (causal case), -C*£ = C£' K = l± +K+2n+2 T 
is the time delay when we estimate x^ n '(to) by D^x^ n '(to)- 
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Corollary 1 If ~ S^ +1 and I n+ i — S n+1 then by minimizing this delay 
Cy' K we also minimize the bias term errors. 

Since, when k, fj, G] — l,+oo[, ^+^+271+2 i ncreases with respect to k and 
decreases with respect to fi, the negative values of k produce smaller bias term 
errors than the ones produced by integer values of k. This is one of the reason 
to extend the values of k. It is clear that one can achieve a given bias term 
error by increasing fi and reducing T (even choosing k, [i as integer) but, as 
we will see later on in Section SI it will increase the variance of the noise error 
contribution. When n . — 1, we can sec the variation of " +2 . with respect to 
(«, n) e] - 1, l] 2 in Figure [1] 



root values 




3.2 Analysis for affinc Jacobi estimators 

It was shown in [35] (for f3 = — 1 causal case), that the bias term error 
e fl K -t n f(^o) m (|14[) produces a time delay of value T£, this is (when there 
is no noise vo = 0): 

D^ N ^(t )^x^(t -TO- 

We always take the value of £ as the smallest root of the Jacobi polynomial 
pjj,+n,K+n ^ _ jy _ n ^ suc j 1 ^ na ^. ^.jjjg a ffj ne causa l estimator may be signifi- 
cantly improved by admitting the minimal time delay. Hence, £ is a function of 
k, [i and n. We denote it by £(k, fi, n). We can see the variation of £(k, /U, n = 1) 
with respect to (k,^) g] — 1, l] 2 in Figure [2] Hence, the extended parameters 
values give smaller value for £(k, fi,n = 1). 
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-0.8 -0.6 -0.4 -0.2 0.2 0.4 0.6 



0.8 



Fig. 2 Variation of (i, n = 1) with respect to k and fi. 

4 Analysis of the noise error contribution 

Before analyzing the resulting noisy error ([27| , let us study the existence of the 
integrals in the expressions of Jacobi estimators. As the noisy observation y is 
the sum of x and noise w, the Jacobi estimators are well defined if and only if 
noise w is integrable. Indeed, according to (|15l) and (|T51) . if vj is an intcgrablc 
function then integrability of w^' K (T)w(t[) +Tt) holds for fx, k s] — 1, +oo[ and 
T 6 T>t . Thus, in that case, the integrals in the Jacobi estimators exist. Now, 
if vo is a continuous parameter stochastic process (see [34]) the next result 
(Lemma [1]) proves the existence of these integrals and thus justifies (@|, (Q 
and ([27]) as soon as the integrals are understood in the sense of convergence in 
mean square (see Proposition[3]). For this, the stochastic process {w{t),t > 0} 
should satisfy the following condition 

(Ci) : {w(t),t > 0} is a continuous parameter stochastic process with finite 
second moments, whose mean value function and covariancc kernel are 
continuous functions. 

Lemma 1 Let {-cd(t),t > 0} be a stochastic process satisfying condition (Ci). 
Then for any to £ I and T £ D ta , the integral f Q w^' K (T)w(to + Tr)dr (with 
/i, K S] — 1, +oo[) is well defined as a limit in mean square of the usual approx- 
imating sum of the following form 



where Y(t) = w^' K (T)m(t + Tt), Yi = Y(£z) for any £/ s]tz_i,tz[ and = 
ro < Ti < • • • < T m = 1 is a subdivision of the interval ]0, 1[, such that 
max (77 — T;_i) tends to when m tends to infinite. 




i=i 



in 
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Proof of Lemma [TJ For any fixed to £ D, it was shown in [32] (p. 472) 
that if {F(t),0 < r < 1}, where F(r) = w /i ' K (r)tu(t + Tt), is a continuous 
parameter stochastic process with hnitc second moments, then a necessary 
and sufficient condition such that the family of approximating sums on the 
right-hand side of (|31[) has a limit in the sense of convergence in mean square 
is that the double integral J Q J E[Y(s)Y(t)} dsdr exists. 
Since for any r G]0,1[, (1 — r) a r* 3 < oo, and {w(t),t > 0} is a continuous 
parameter stochastic process with finite second moments, so does {Y(r),0 < 
t < 1} for any to G I. Moreover, since the mean value function and covariance 
kernel of w(t) are continuous functions, so does E[w(to + Tt) w(to + Ts)] for 
all r, s G [0, 1]. Hence, E[m(t +TT) m(t + Ts)] is bounded for all r, s G [0, 1]. 

Consequently, w fl ' K (T)w fJ '' K (s) E[w(t + Tt) w(t + Ts)} ds dr exists 

when k, fj, G] — 1, +oo [, which implies that (|31|l holds. ■ 

If we take y instead of w in the previous lemma, then we can obtain the 
following proposition. 

Proposition 3 If x G C n+1 (I), and the noise w satisfies condition {C\), 
then for any to G /, the integrals in the Jacobi estimators exist in the sense of 
convergence in mean square. 

From now on, we can investigate the noise error contributions for these 
Jacobi estimators. Mainly the Bienayme-Chebyshev inequality is used to give 
two error bounds for these errors. Let us denote the noise error contributions 
for the Jacobi estimators e^pT,N,(, 

(t ) (see (ET])) by e^(t ), then for any real 

number 7 > 

Pr (J4 T (M - E[ei T (t )}\ < 7V Var[e& T '(*o)]) > 1 - ^, (32) 

i.e. the probability for e^(to) to be within the interval ]Mi,Mf l [ is higher 
than 1 - jj, where M l = E[e% \to)]-i^Var[e% \t )] and M h = E[ei T (t )] + 

^ \J V ar[e^J (to)]. These error bounds Mi, Mh depend on the parameters k, fx, 
T and ^ which can help us in minimizing the noise error contributions. From 
the previous section, we have extended the values of re, fj, from N to ] — 1, +00 [. 
Hence, we obtain a higher degree of freedom so as to minimize the noise effects 
on our estimators. In order to obtain these bounds we need to compute the 
means and variances of these errors. 

To do so, firstly, Subsection 14.11 considers noises as continuous stochastic 
processes: it is shown that such Jacobi estimators can cope with a large class 
of noises with mean and covariance polynomials in time for which Mi , Mh are 
obtained. Let us note that this class includes well known processes such as the 
Wiener and the Poisson ones. Secondly, Subsection 14.21 deals with the discrete 
case for these noises. 
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4.1 Noise error contribution in the context of a stochastic process noise 

Let us assume that noise w satisfies condition (Ci). To simplify our notations, 
let us denote the power functions Pg' T n N ^ associated to the Jacobi estimators 
by y T . Then by applying Theorem 3A in |34] (p. 79) the means, variances and 
covariances of the noise error contributions for the Jacobi estimators are given 
as follows (VT > 0, Ti > 0, andT 2 > 0) 

E [ei T (t )] = f / T (r) E [w{t Q + (3Tt)} dr, (33) 
Jo 

Cov [e^(t ),e^(t )] 

r 1 r 1 (34) 

= / / p l3Tl {s)p pTl {T)Cov[zo{t + I3T 1S ), w(t + /3T 2 T)} dsdr, 
Jo Jo 

Var[ei T (to)}=Cov[ei T (t ),ei T (t )]. (35) 

By using the property of power function Pp^ n defined in (|15p . the following 
theorem shows that such Jacobi estimators can deal with a large class of noises 
for which the mean and covariance are polynomials in time satisfying the 
following conditions 

(C 2 ) : V(t + t) G I, the following holds 

n-l 

E[w{t +r)] = ^ n t$ l( V + E[w(t% (36) 

i=0 

Hi ri2 

Cov[m{t + s),w(t +t)]=Y^ Vi *S aW r* £ v'i 4^ + Cou[w{s),w{r)], 

i=0 i=0 

(37) 

where fei(i) G N, k 2 {i) G N, k 3 (i) G N, i>i G R, m G R, ^ G R and m G N, 
ri2 G N such that min(ni,n2) < n — 1. 
(C 3 ) : Vr e /, the following holds 

EW^^t', (38) 

z=0 

Til ™2 

i=0 i=0 

where Vi G R, rji,^ G R and min(ni, 77,2) < n — 1 

Theorem 1 Let e^J (t ) be the noise error contribution for the Jacobi esti- 
mator Dp£ N (to) where the noise {vj(t),t > 0} satisfies conditions (C\) 
and (C2). If n G N*, then the mean, variance and covariance of e^(to) do 
not depend on to. If in addition the noise {vj(t),t > 0} satisfies conditions 
(C 3 ) then E[ei T (t )} = 0, Cov[e^(t ),e^(t )] = and Var[e?J{t )} = 0. 
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Proof. According to (fT"5]) and (|16[) . p" T is a sum of Jacobi polynomials of 
degree n, then by using the orthogonality of the Jacobi polynomials it is easy 
to obtain 

/ t 1 - 1 p f)T (t) dr = 0, for any Z e {l,...,n}. (40) 
Jo 

Then by applying (|4U|) . (|3"3")) and (|3"4")l with the conditions given in and 
(j3ZJ) we obtain 

£ [e^(to)] = f P fiT (r) E [w((3Tr)} dr. (41) 
Jo 

Cov [e^(t ),e^(t )} 

r 1 r 1 (42) 
= / / p 0Tl (T)p t3T2 (s)Cov[m(l3T 1 T), w{[3T 2 s)] dsdr. 
Jo Jo 

Consequently the mean and covariance of e^J {to) do not depend on to- If 
we take T\ = T 2 in |42|) . then the variance of e(^ T (i ) do not depend on to- 

n-l 

Moreover, if E[vd{t)\ = Pj r 1 , then by applying (|4T))) to (|4T|) . we obtain 



i=0 



-E[e£ T (i )] = 0. If Cov[vj{s),w{t)} = ^ 77, r* ]T $ s l with min(n 1 ,n 2 ) < 

i=0 i=0 

71 - 1 then by applying gO) to (|32]l. we obtain Co7j[e^ Tl (rj ), e^f 2 (t )] = 0. 
Then if we take Ti = T 2 in g2j), we get Var[e^{t )} =0. ■ 
From which the following important theorem is obtained. 

Theorem 2 Let e^ T (t ) be the noise error contribution for the Jacobi esti- 
mator Dp£ N ^x^ n ' (to) where the noise {zu{t),t > 0} satisfies conditions (C\) 
to (C3), then 

e^J {to) = almost surely. (43) 

Proof. If the noise {zu{t),t > 0} satisfies conditions (Ci) to (C3), then we 
have E[e^{t )} = and Var[e^{t )} = 0. Since 



E 



^J{to)) 2 ]=Var [ei T {to)]+{E[ei T {to)]f 



we get E 



'{to)) 2 = 0. Consequently, we have e^ {to) = almost surely. 



Two stochastic processes, the Wiener process (also known as the Brownian 
motion) and the Poisson process (cf [34]), play a central role in the theory of 
stochastic processes. These processes are valuable, not only as models of many 
important phenomena, but also as building blocks to model other complex 
stochastic processes. They are characterized by: 

— let {W{t),t > 0} be the Wiener process with parameter er 2 , then 

E [W{t)\ = 0, Cov [W(t), W(s)} = a 2 min(i, s); (44) 



Error analysis of a class of derivative estimators for noisy signals 



15 



— let {N(i),t > 0} be the Poisson process with intensity i/gl 
E[N(t)} =vt, Cov[N(t),N(s)} =vxmn(t,s). 



then 



(45) 



Thus, these processes satisfy conditions (Ci) and (C2). Hence, we can charac- 
terize the noise error contributions due to these two stochastic processes for 
the Jacobi estimators, and calculate the corresponding means and variances. 
If the noise is a Wiener process, then it is clear that E[e^J '(to)] = 0. If the 
noise is a Poisson process, then we have 

Proposition 4 The means of the noise error contributions due to a Poisson 
process for the Jacobi estimators are given by 



fl.K 



(to) 



= 0, 



(to) 



E 



(to) 



ifn>2 7 
v, ifn = 1, 



(46) 



where e^^ T (to) (resp. g T N _ 2 e(to) ) * s the noise error contribution for 
the minimal Jacobi estimators D&pxfyo) (resp. the affine Jacobi estimators 
Dot N p£(to)) which is the estimates of the first order derivative of x. 

Proof. For n > 2, this can be simply proved by using Theorem[T] Thus we only 
need to compute the means of the noise error contributions for the estimates 
of i. Let n = 1 in then the minimal estimators can be written in the 
following form 



where P^(t) 



pr r{K+2)r{n+2) 



(i 



P/3T ( T ) v(P Tt + to) dr, 



(47) 



((// + k + 2)r - (« + 1)) (1 - tYt k . 



The affine estimators Dg^ 2 f i(to) are given by ([T 



D PT,2^(to) = Xi(i, k, fi)D^ T ' K x(t ) + Ao(£, k, fi)Dp£ a; (t ), 

where Ai(£, k, fj) = (k + 3) — (fx + k + 5)£ and Ao (£, k, (a) = 1 — Ai (£, k, /j,) were 
obtained in [21]. According to (|4T)l. it reads 



x(to)= I P$t,2,^( t ) vW Tt + to)dr, 



(48) 



where PgT,2^( T ) 



According to (|4"Tj) we obtain 



Ai(C, K, n)p^ 1,K (r) + A (£, K, n)p^ +1 (r). 



E 



(to) = ^/3T / t P ^(t) dr. 



By using integration by parts and the classical Beta function, we obtain 



E 



e ^f3r(to) 
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Moreover, since Aq(£, k, fi) + Ai(£, K, fx) = 1 , one gets 



E 



"j3T 



Thus, this proof is completed. I 
Now, in order to get the error bounds for the noise error contributions us- 
ing the Bienaymc-Chebyshcv wc should compute the variance. Since the 
covariancc kernels of the Wiener process and the Poisson process are deter- 
mined by the same function min(-, •), the variances of the noise error contribu- 
tions due to a Wiener process or a Poisson process for the Jacobi estimators 
Dft*x( n \t ) is given by (Using g2} with T = T 1 = T 2 ) 



Var 



e mV(*o) = V / Ppr ( T ) Ppr ( s ) min(/3Ts, (3Tt) ds dr, 
J Jo Jo 



where p££(t) = (^"^(J+n+M+n+i) ■ Usin S thc symmetry property of func- 
tion min(-, •) and the fact that J T Pp'^(s) ds = — /J'p/jt ( s ) we obtain 



Var 



p T {to) =2r}T Pp T ( T ) T Pp T (s)dsdr. 



(49) 



Since 



(n) 



n,K+n( T ) T I w M-n, K +ni s )ds dr 



n\{n - 1)! / ^ +1 , 2k+2 (t) P^(r) P^l' K+1 (r) dr 



(50) 



wc have 



Var 



(to) 



2?yn!(n - 1)! 



T 2 "- 1 B 2 (k + ra + 1,/t + n + 1 



■I(fj,,K,n). (51) 



with 



7( M , «, n) = f l w w , 2k+2 {t) P^ k (t) P^I' k+ \t) dr. 
Jo 



Let us stress that Var 



(to) 



1 



(52) 



For n = 1, we have thc following results: 

Proposition 5 T7ie variances of the noise error contributions for the Jacobi 
estimators of the first order derivative of x are given by 



Var 



'■w,0T 



(to] 



2r; M + 1 -B( 2 M + 2, 2k, + 3) 
I 7 2/j + 2k + 5 5 2 (k + 2,// + 2) ' 



(53) 
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for minimal estimators and by 



Var 



n7,/9T,2,f (*0j 
2l] fX 



2 5(2^ + 4, 2k + 3) 



+ A (£, k,/i) 



T 2/x 
2rj 



2k 
/' - 



-7 B 2 (k + 2,^ + 3) 
1 £(2^ + 2, 2k + 5) 



(54) 



+ \q{£,,k,h)\ 1 {£,k,h) 



T 2^i + 2k + 7 B 2 (k + 3,h + 2) 

2-q B(2^ + 4,2k + 4) 



T B(k + 2,(i + 3)B(k + 3,ii + 2) 



for afftne estimators. The value n is equal to a 2 , if the noise is a Wiener 
process, and r\ is equal to v , if the noise is a Poisson process. 



Proof. Since 



k, n = 1) = 



(/x+ 1)5(2^ + 2, 2k + 3) 



2/i + 2k + 5 

and using ([STjl one gets the desired result. Similarly for Var 



(to) 



As a consequence, since -E[e^''^ T (to)] = E[e^ K p T2 ^ v 



t{to)] = v for a Wiener 

process (y = 0) or Poisson process [y ^ 0, where v is the intensity parameter of 
the Poison Process), using the well known Bienaymc-Chebyshev (|3"2")l we obtain 
the error bounds for the noise error contributions for the Jacobi estimators of 
the first order derivative of x. 

Theorem 3 (First order derivative estimation) Let n = 1. Let the noise 
be a Wiener process or Poisson process, then for any real number 7 > 0, 



Pr 



(to)]-*! < 7yW[e£* T (r )]) 



1 

> 1 - — , 

T 



Pr 



( e £,£T,2,f (*°)] ~ v < 7^/^ar-[e^^ Ti2i? (t )]) 



> 1 



(55) 



(56) 



where v = /or a Wiener process; v + 1 /or a Poisson process and Var[e^ p T (to)], 
Var\e^ K p T 2 ^(£0)] flre given respectively by \53§ and \54\ . 

For the case n = 1, the bounds given by Theorem [3] characterize the noise 
error contribution e(£'l T (io) (respectively e^ K _ T 2 ^(io)) f° r the Jacobi estima- 
tion D^ K _ T x(to) (respectively D^ h _ T 2 £±(io)). They depend on Var e^ K _ T (to) 

(to) given by Similar results 



given by (|53|) (respectively Var 
can be obtained for n = 2 since 

2J(/i, k, n = 2) = - (k + 2) 2 (k + l)5(2/i + 5, 2k + 3) 

+ (k + 2)(/i + 2) (3k + 5)B(2^i + 4, 2k + 4) 
- (k + 2)(jU + 2)(3/i + 5)B(2/i + 3, 2k + 5) 
+ (^ + 2) 2 (^ + l)B(2/i + 2, 2k + 6). 
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and of course for higher values of n. Remember that, for fixed T, we have 



Var 



rpin-i ). Since all these variance functions decrease with 



respect to T independently of k and fi, it is sufficient to observe the influence of 
k and [i. In the minimal Jacobi estimator case one can get a direct computation 
(result is reported in Figure [3] by taking r) = T = 1) whereas in the affine case 
it is not difficult to obtain a 3-D plot as in Figure 2] and where rj = T = 1, 
£ = £(«;, fi) is the smaller root of p£+ 1 > K+1 _ Yrom this analysis, we should take 
negative values for k and fi so as to minimize the noise error contribution. 
Moreover, we can observe that the variance of e^ K _ 12 ^i(to) is larger than 
the one of e^ ft _ 1 i(to) if we take same value for k and /i, hence we should 
take the value of T for affine estimator D^ K _ T 2 ^x(to) larger than the one for 
D^ h _ T x(to) so as to obtain the same noise effect. 




Fig. 3 Variances of the noise errors for the minimal estimators. 
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(c) n = 3 (d) n = 4 



Fig. 4 Variances of the noise errors for the affine estimators. 

Usually, the observation function y is only known on discrete values. Con- 
sequently, in the next subsection we will study discrete noise cases. 



4.2 Noise in the discrete case 

Let us now assume that y(ti) = x(U) + zu(ti) is a noisy measurement of x in 
discrete case with an equidistant sampling period T s , where noise w is assumed 
to satisfy condition (C\) given in Subsection 14. II Let us recall that the Jacobi 
estimators of the n th derivative of x can be rewritten as follows 

t)^ N x^(t Q ) = f jfc N6 (T)y(t +pTT)dT. (57) 
Jo 

Since y is a discrete measurement, we need to use a numerical integration 
method to approximate the integral value in ([57]) . Let t% = j- and Wi > for 
i = 0, . . . , m with m=^£PI (except for wq > and w m > 0) be respectively 
the abscissas and the weights for a given numerical integration method used 
in (|57|) . Weight wq (resp. w m ) is set to zero in order to avoid the infinite values 
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when k (resp. j£) is negative. Then, we have 

rn 

D^ N ^ n \t ) « ^^(t,)»(to + ^Tti). (58) 



i=0 



Hence, the noise error contribution e^^ TAr ^(io) can be written in discrete 
cases as follows 



e «,V,Jv,e(*o) = J! -^P'pr^N^i) ro ^o + /3Ttj). (59) 



This numerical integration method also implies an error which will be stud- 
ied in a future work. Consequently the Jacobi estimators lead to 

^JV,^ (n) (*o) = ^ ( " ) (^o) + e m (to) + e^ /3T ^^ im (io) + e^J T!jV!4!m (t ), (60) 

where e^' K p T N ^ m (to) is the bias term error in discrete cases, e^^ T N ^ m (io) is 
the noise error contribution in discrete cases (which will be shortly denoted by 
e ro T m(^o) hereafter) and e m (to) is the numerical integration error. To simplify 
the notations, as in the previous section, p^ T denotes power function p^ n N ^ ■ 
Then by applying the properties of the mean, variance and covariance, we have 

^ m 

e [<™(*o)] = - ]T w * p^(*<) E M*o + pru)] , (6i) 

rn 

Var [ei T m (t )] = — ^ wj (p 0T (U)) 2 Var [w{t Q + pTU)] 

^ m — 1 m 



m 

i=0 j=i+l 



(62) 

Moreover, for any T\ > and T2 > 
Co« [e^,(to),Ot )] 



^ m m 



(63) 



m 

i=0 j=0 



Now, by using Bicnaymc-Chcbyshcv f|32|) and the previous formulae, we 
can derive similar results than the ones obtained in the previous subsection 
and which coincide if m — > 00. However this is true with some few additional 
assumptions as detailed below. 

In order to show the bridge with the previous Subsection 14.11 we will use 
the following properties, where T, T\ and T2 are given (finite), and T s tends 
to 0, i.e. m tends to infinite. 

lim E[e^ m (to)]=E[ei T (t Q )}, (64) 
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lim Var [e^ m {t )] = Var [eg T (t )] , (65) 

lim Cov [ei%(t ),e^ m (t )] = Gov [e^ (t ) , e^(t )] . (66) 

From now on, let us consider a family of noises which are continuous pa- 
rameter stochastic processes satisfying the following conditions 

(C4) : the mean value and variance functions of {w(t), t > 0} arc continuous 
functions; 

(C5) : for any s,t > 0, s 7^ t, vu(s) and w(t) are independent. 

Note that white Gaussian noise and Poisson noise satisfy these conditions. 
Then, we can give the following theorem. 

Theorem 4 Let {w(t),t > 0} be a continuous parameter stochastic process 
satisfying conditions (C4) and (C5). Let vj(ti) be a sequence of {vu(t),t > 0} 
with an equidistant sampling period T s . If n,fi> — |, then we have 

lim Var [e^ m (t )] = 0, (67) 

where e^ m (to) is the associated noise error contribution for the Jacobi esti- 
mators defined by (59\) . 



Proof. Since w(ti) is a sequence of independent random variables, by using 
(l62l) we have 



Var [e^ m (t )] =\ ]T w i (P^^)) 2 Var [w(t + 131%)] . (68) 

i=0 

Since the variance function of w is continuous, we have 

to ' — ' m ' — ' to 

i=0 i=0 

(69) 

where w(m) = max to* and [/ = sup \Var [m(to + /3Tt)]| < 00. Moreover, 
0<i<m o<t<i 



lim 2-(P^(*i)) a = / (P^(*)) 2 *. 



(70) 



Since Pg'£ n N * is a sum ofpp'^ n (see (dU)), according to the expression of n 

given in ([T5]l. J* (p^ T (*)) 2 < 00 if J* (1 - T) 2 ^T 2k dr < 00. Consequently, as 
all Wi are bounded, if k,/i > — ^ then 

lim ErUlMfst^^o. 

m->oo TO z — ' TO 
i=0 

The proof is completed. ■ 
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According to the previous theorem, if we apply the Bienayme-Chcbyshev 
inequality and (|rj4"|) . then we can obtain that e^ m (to) converges in probability 

to p 137 '(t) E[vj(t + PTr)]dT when T s — » 0. Moreover, if we use the fact 
that E (Y m — c) 2 — Var [Y m ] + (E [Y m ] — c) 2 for any sequence of random 
variables Y m , then we can get the convergence in mean square. 

Corollary 2 Let {w{t),t > 0} be a continuous parameter stochastic process 
satisfying conditions (C4) and (C5). Let w{ti) be a sequence of {w{t),t > 0} 
with an equidistant sampling period T s . If k, \i > —\, then e!^ m (to) converges 

in mean square to J Q p^ t {t) E\m(ta + /3Tt)] dr when T s — > 0, where p^ T is 

n-1 

E 

i=0 

converges in mean square to when T s — > 0. 



defined in (|_?6]) . Moreover, if E[w{t)\ = \ ViT 1 with V{ E M, then e^ m (to) 



n-1 

Proof. If ^^(r)] = Vi t 1 with Vi G R, then similarly to Theorem Q] we 

i=0 

can obtain J Q p^ t {t) E[w(t^ + (3Tt)] dr = 0. Hence, this proof is completed. 



5 Numerical experiments 

If k (rcsp. fi) is negativ e, P^ x n n £ m ay be infinite at r = (resp. r = 1). In 
the previous Subsection 14.21 we choose u>o = (resp. w m = 0) so as to avoid 
this problem. But this choice of wo and w m implies an error (see |23p. In order 
to reduce this error, we replace the term t k at r = (rcsp. (1 — r)** at r = 1) 
m PpT, n> N,i h y (mT ( res P- (m)^) with F G ] ' X l when K ( res P- M) is negative. 
For example, the power function in the minimal Jacobi estimators Dg' T x(to) 
is 

pg£( T ) = / > + K + 4 ) (( + K + 2 ) T -U + 1)) (1 _ T y T \ 

If k < and /i > 0, then we take 

In the two following subsections, we use the trapezoidal rule as the numer- 
ical integration method. 



5.1 Simulation results with a Brownian motion noise 



In this subsection, we assume that y{ti) = x(ti) + Cw(ti) with i; = T s i for i = 
0, • ■ ■ , 1000 (T s = 2^0)1 is a noisy measurement of x{t{) = cxp(^-y) sin(6t; + 7r). 
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0.6 




1 2 3 4 5 

(a) The noisy measurement y(ti) and x(t{). 




(b) The associated Brownian noise Cro(tj). 

Fig. 5 The given data. 

Noise Cm is assumed to be a Brownian motion defined by with a 2 = 1 and 
C > 0. The coefficient C is chosen so that the signal-to-noise ratio SNR = 

101 °gio ( e^c^'i 2 ) is equal t0 SNR = 16dB ( see ' e -s-' for this wel1 

known concept in signal processing) . Figure [5] reports the noisy measurement 
with its associated noise. 

We use the minimal causal estimator D^x(to) defined in (|T7)) and the 
affine causal estimator ^(to) defined in (|48p to estimate the first order 

derivative of x. It was shown in the previous sections that the bias term errors 
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Minimal estimators 



first order derivative 
with k<0 and ^=0 




(a) D^x(t ) with k = = 0, T = 18T S and D*'£x(to) with k = 
-0.79, n = 0, T = 30T B and F = 0.1. 



Affine estimators 




(b) D^ 2( x(t ) with K = fl = 0, T = 30T S , £ = 0.276 and 
Dt^ 2i ±(t ) with re = -0.78, n = -0.6, T = 46T S , £ = 0.218 
and F = 0.1. 

Fig. 6 Estimations obtained by using the Jacobi causal estimators. 



(Section[3]) and the noise error contributions for the Jacobi estimators (Section 
3]) both depend on the parameters k, [i, T and £. We have previously shown the 
parameters' influence on the time delay values (the bias term errors) and the 
noise error contributions for the minimal estimators D^i(to) and the afBnc 
estimators 2 t i(to). In order to obtain an "optimized" error (minimum), 



Error analysis of a class of derivative estimators for noisy signals 



25 



it is clear that wc should take a negative value for k. Concerning the choice 
of T wc should make a compromise since small T makes the bias term error 
small but also produces large noise error contribution. We take negative value 
for fj, so as to reduce noise error contributions. We can see in Figure |H] the 
obtained estimations respectively by using the minimal causal estimators and 
the affine causal estimators. 

In each figure, the solid line represents the exact derivative of x, the dashed 
line represents the time-delayed estimation with k, \i £ N and the dotted line 
represents the estimation with k, fx G] — 1, +00 [. We can see the "delay-free" 
estimations with k, (J, s] — 1, 0]. In fact, we can find out an appropriate value 
for F and m, so that the numerical integration method error reduces the bias 
term errors and the time delay values. The analysis for such errors will be 
studied in a future work. 

The associated noise error contributions for the estimations obtained by 
using respectively the affine estimator with k,/i£N and the ones with k, /jl € 
] — l,+oo[ are shown in Figure [7] In this figure, the error bounds for these 
noise error contributions are also shown. The dotted lines represent the error 
bounds obtained in the continuous case by using Theorem [3] with 7 = 2. The 
dashed lines represent the error bounds obtained in this discrete case by using 
a discrete counter part of Theorem [3] with 7 = 2. 

In order to compare these estimations, we calculate the total error vari- 
ance Jq 5 e(r) 2 iiT for each estimate. As the measurement is discrete, we take 

1000 

T s e ( T i) 2 as the approximation of J Q 5 e(r) 2 dT. We also consider the SNR 

i=0 

by calculating each estimate and the associated noise error contributions. The 
error variance and the SNR value for each estimate are given in Table [TJ All 
the values are calculated in the same time interval [50T S , 5]. We can see that 
with the same SNR value the estimations obtained with k,/j, g] — 1,0] pro- 
duce smaller total errors than the ones obtained with k, fi € N. Moreover, we 
calculate the time delay for the estimates obtained by using minimal causal 
estimator with K,(igN (resp. affine causal estimator with n, \i G N) which is 
given by K +~^+2n+2 ^ ( rcs P- A 4 ))- We will make the same comparison in 

the next subsection. 



Table 1 Error variance, SNR and time delay value in each estimate 



F = 0.1 


D°_!° 1STg x(t ) 


AO, -0.79./. ^ 

d -3ot s x y t o) 


/ S e(r) 2 dr 
SNR 
Theoretical Delay 


0.5506 
27.8019 
0.045 


0.0181 
27.5795 
0.0565 


F = 0.1 




£-0.6,-0.78 . (t) 


/ S e(r) 2 dr 
SNR 
Theoretical Delay 


0.5148 

27.6765 
0.0414 


0.0197 
27.9936 
0.0501 
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Noise error contribution in the affine estimator 



0.1 



0.05 - * 



-0.05 ■ 




continuous 

continuous 

- discrete 

- discrete 

* noise error 



(a) Noise error contributions e 
fx = 0, T = 30T S , £ = 0.276. 



ro,-T,2,£V 



(to) in D^'£ 2 ^x(to) with re : 



Noise error contribution in the affine estimator 



0.15 r 




(b) Noise error contributions e^' K _ T 2 j(*o) m D^_'£, 2 ^i(to) with re = 
-0.78, n = -0.6, T = 46T S , £ = 0.218 and F = 0.1. ' 

Fig. 7 Noise error contributions for the affine estimators and the error bounds. 



5.2 Simulations results with a white Gaussian noise 

Let y(U) = sin(2t 4 ) + Cvu(U), with U = T s i for i = 0, • • ■ ,445 (T s = be 
a noisy measurement of sm(2fj). The samples of noise Cvj(U) are simulated 
from a zero-mean white Gaussian zzcZ sequence where coefficient C is adjusted 
in such a way that SNR = 20dB (see Figure [5]). 
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-1.5 ' 1 ' ' ' ' ' 

2 4 6 8 10 12 14 

(a) The noisy measurement y(ti) and the smooth function x(U). 

0.25 r 




(b) The associated white Gaussian noise Cvo(ti). 
Fig. 8 The given data. 



We use the minimal causal estimator D^x(to) defined in (|T7)) and the 
affinc causal estimator 2 ^i(to) defined in to estimate the first order 
derivative of x. We can see in Figure H] the estimations obtained respectively 
by using the minimal causal estimators and the affine causal estimators. 

In each figure, the solid lines represent the exact derivative of x, the dashed 
lines represent the time-delayed estimation with k,/i£N and the dotted lines 
represent the "delay-free" estimation with g] — 1,0]. The error variance 
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Minimal estimators 



- first order derivative 
with k<0 and \i=0 

- with k=^i=0 




10 12 14 



(a) bt'^x(to) with k = fi = 0, T = 25T a and D^'£x(to) with k 
-0.75, fi = 0, T = 25T B and F = 0.5. 



Affine estimators 



first order derivative 
with k < and (i <0 

with K=(!=0 




10 12 14 



(b) Dt^ 2i x(t ) with k = p. = 0, T = 38T S , £ = 0.276 and 

-D^T2 -i(to) with k = -0.7, fi = -0.66, T = 32T S , § = 0.234 and 
F = 0'.5. 



Fig. 9 Estimations obtained by using the Jacobi causal estimators. 



and the SNR value for each estimate are given in Table [H All the values are 
calculated in the same time interval [38T S , 14]. 
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Table 2 Error variance, SNR and time delay value in each estimate 



F = 0.5 




AO. -0.75 . /. \ 
D -25T 3 x (*0) 


/ 6 e(r) 2 dr 
SNR 
Theoretical Delay 


2.2351 
27.5396 
0.3927 


0.1855 

27.7133 
0.3021 


F = 0.5 


f)°'° 1 

-38T S ,2,0.276 °' 


A-0.66,-0.7 \ 
-32T S ,2,0.234 \ ' 


Jo <rfdr 
SNR 
Theoretical Delay 


1.7919 

27.5376 
0.3295 


0.0085 

27.2715 
0.2352 



6 Conclusion 

In this article, we study recent algebraic parametric estimation techniques in- 
troduced in [25] which provide an estimate of the derivatives by using iterated 
integrals of a noisy observation signal. These algebraic parametric differentia- 
tion techniques give derivative estimations which contain two sources of errors: 
the bias term error and the noise error contribution. In order to reduce these 
errors, we extend the parameter domains used in the estimators. Then, we 
study some error bounds which depend on these parameters. This allows us to 
minimize these errors. We show that a compromise choice of these parameters 
implies an "optimized" error among the noise error contribution, the bias term 
error and the time delay. We also give some examples where the errors due to 
numerical integration method permit us to further reduce the time delay of 
the estimators. We will study this interesting fact in a future work. 
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